High-fidelity haptics in multimodal human-robot interaction
نویسنده
چکیده
Introducing haptics into human-robot interaction brings new challenges to control algorithm development as the robot stays in physical contact with the human user. When the aim is to design a system which interacts with the human in a natural and plausible way similar to two humans carrying out the same task, the main challenges are to estimate human intentions online and to plan the behavior of the robot accordingly. This work addresses the challenges of human intention estimation, online robot action generation and the integration of visual and sound feedback signals into the haptic system. Different stages of the system have been evaluated by a series of user studies.
منابع مشابه
Understanding haptics by evolving mechatronicTMsystems
Haptics can be defined as the characterization and identification of objects by voluntary exploration and somatosensory feedback. It requires multimodal sensing, motor dexterity, and high levels of cognitive integration with prior experience and fundamental concepts of self versus external world. Humans have unique haptic capabilities that enable tool use. Experimental animals have much poorer ...
متن کاملTowards Effective Communication with Robotic Assistants for the Elderly: Integrating Speech, Vision and Haptics
Our goal is to develop an interface for older people to effectively communicate with a robotic assistant so that they can safely remain living in their home. We are devising a multimodal interface since people communicate with one another using a variety of verbal and non-verbal signals, including haptics, i.e., physical interactions. We view haptics as an integral component of communication, w...
متن کاملTowards Robust Human-Robot Interaction using Multimodal Cues
Real-world domains characterized by partial observability and nondeterminism frequently make it difficult for a robot to operate without any human feedback. However, human participants are unlikely to have the time and expertise to provide elaborate and accurate feedback. The deployment of mobile robots to interact with humans in dynamic domains hence requires that the robot learn from multimod...
متن کاملAn Experimental Study on Blinking and Eye Movement Detection via EEG Signals for Human-Robot Interaction Purposes Based on a Spherical 2-DOF Parallel Robot
Blinking and eye movement are one of the most important abilities that most people have, even people with spinal cord problem. By using this ability these people could handle some of their activities such as moving their wheelchair without the help of others. One of the most important fields in Human-Robot Interaction is the development of artificial limbs working with brain signals. The purpos...
متن کاملMultimodal Haptic Perception within Granular Media via Recurrent Neural Networks
The sense of touch is essential for locating, identifying, and grasping buried objects when vision-based approaches are limited. In this work, we introduce an approach for haptic perception within granular media that leverages three different tactile sensor modalities (vibration, internal fluid pressure, fingerpad deformation). Online dictionary learning was used to pretrain inputs to recurrent...
متن کامل